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We consider the following problem in one-dimensional diffusion- 
limited aggregation (DLA). At time t, we have an "aggregate" con- 

(N ■ 

sisting of Z n [0, -R(£)] [with R(t) a positive integer]. We also have 
, N(i, t) particles at i, i > R(t). All these particles perform independent 

q> ■ continuous-time symmetric simple random walks until the first time 

t' > t at which some particle tries to jump from R(t) + 1 to R(t). The 
• , aggregate is then increased to the integers in [0,R(t')] = [0,R(t) + 1] 

t^h ' [so that R(t') — R(t) + 1] and all particles which were at R(t) + 1 at 

i time if — are removed from the system. The problem is to determine 

■ how fast R(t) grows as a function of t if we start at time with 
i i ' R{0) = and the N(i,0) i.i.d. Poisson variables with mean fi > 0. It 

is shown that if fi < 1, then R(t) is of order yt, in a sense which is 
t-H ■ made precise. It is conjectured that R(t) will grow linearly in t if /i 

^ ' is large enough. 

m : 
t> . 

^-H ■ 1. Introduction. Before we begin the discussion of the speed at which 

the aggregate in the diffusion-limited aggregation (DLA) model grows, we 
0^ | explain how we came to this problem from studying another growth model. 

■ In Kesten and Sidoravicius (2005), we studied the following model for the 
[ spread of an infection. There is a "gas" of particles, each of which performs 

a continuous-time simple random walk on Z, d with jump rate Da- These 
• »h . particles are called A-particles and move independently of each other. They 

r> | are regarded as healthy individuals. We assume that we start the system 

with A^^(a;,0— ) A-particles at x and that the Na{x,0—), x G Z d , are i.i.d., 
mean-^,4 Poisson random variables. In addition, there are B-particles which 
perform continuous-time simple random walks with jump rate Db- We start 
with a finite number of U-particles in the system at time 0. l?-particles are 
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interpreted as infected individuals. The i?-particles move independently of 
each other. The only interaction is that when a -B-particle and an A-particle 
coincide, the latter instantaneously turns into a £>-particle. 

In Kesten and Sidoravicius (2005), we investigated how fast the infection 
spreads. Specifically, if B(t) := {x G Z d :a £>-particle visits x during [0,t]} 
and B(t) = B(t) + [— l/2,l/2] d , then we investigated the asymptotic be- 
havior of B(t). The principal result in Kesten and Sidoravicius (2005) states 
that if Da = Db (so that the A- and 5-particles perform the same ran- 
dom walk), then there exist constants < C% < oo such that almost surely 
C{C 2 t) C B(t) C C(Cit) for all large t, where C(r) = [-r,r] d . In a further 
paper, Kesten and Sidoravicius (2006), we proved a full "shape theorem" 
which states that t~ 1 B(t) converges almost surely to a nonrandom compact 
set Bq with the origin as an interior point, so the true growth rate for B(t) 
is linear in t. 

If Da Db, then we could only prove the upper bound that B(t) C 
C{C\t) eventually. However, there is one extreme case for which a shape 
theorem and linear growth of B{t) has also been proven. This is the so- 
called frog model in which Da = 0, that is, the healthy particles stand still 
until they are infected [see Alves, Machado and Popov (2002) and Ramirez 
and Sidoravicius (2004)]. 

To get a better feel for the problem, we wanted to investigate the other 
extreme case, namely when Db = 0. Taken literally, this is not an interesting 
case. In this case, the infected particles stand still and act as traps for the 
healthy particles. All that happens with any given ^4-particle is that it walks 
around until it coincides with one of the -B-particles, after which it also 
stands still. The infected set B(t) equals -B(O) at all t > and the speed at 
which the infection spreads is 0. To obtain something interesting, we have to 
allow the S-particles to move, at least at some times. The simplest situation 
is the one-dimensional one, that is, when d = l. We chose to let a 5-particle 
move one unit to the right when an ^4-particle jumps on top of it. According 
to our rules, all A-particles which were one unit to the right of the S-particle 
are turned into -B-particles at the time of this jump. This leads to the model 
described in the abstract. 

The model described in the abstract is of further interest because it is a 
one-dimensional version of the celebrated DLA model of Witten and Sander 
(1981). In this model on Z d , one again has a growing aggregate A(t) C Z d and 
one starts with A(l) = {0} = the origin. Usually, t is taken to run through 
the integers and A(t) has cardinality t. A(t + 1) is obtained from A(t) by 
adding one point of Z rf . This added point is the first point of the boundary 
of A(t) which is reached by a random walker which starts at infinity [see 
Kesten (1987) for a more precise description]. The main difference between 
the model in the abstract and the DLA model of Witten and Sander is that 
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the latter adds one ^4-particle to the system at a time, while in the former, 
there are infinitely many ^4-particles from the start. However, there have 
been various investigations for related models in which new ^4-particles are 
added to the system before all previously released yl-particles have reached 
the boundary of the aggregate and are removed from the system; see, for 
instance, Lawler, Bramson and Griffeath (1992). In the physics literature, 
almost the same model as we discuss here was already studied by simula- 
tions in Voss (1984). However, in that paper, the ^4-particles do not perform 
independent random walks, but the system of ^4-particles evolves as an ex- 
clusion process; moreover, Voss (1984) considers the two-dimensional case. 
Also, Chayes and Swindle (1996) investigated hydrodynamic limits for the 
one-dimensional case in which the A-particles follow exclusion dynamics. 
We remark that the particle density in an exclusion process is necessarily 
at most 1. As we shall see, in our model, the case when the particle density 
fj, is less than 1 can be handled much better than the case with fj, > 1. We 
have few results in the latter case. 

As a side remark, we point out that DLA is usually considered in dimen- 
sion d > 1, in which there is a whole new level of difficulty because we do 
not know how to describe the "shape" of A(t). 

Let us now turn to the problem raised in the abstract, namely the rate at 
which R(t) grows. We take tq = 0. As stated, we take R(0) = R(tq) = and 
N(i,0), % > 1, an i.i.d. sequence of mean-/i Poisson random variables. All 
particles perform independent continuous-time simple random walks with 
jump-rate D until they are absorbed by the aggregate. Unless otherwise 
stated, by "simple random walk," we mean a symmetric simple random 
walk. It is convenient to let the particles continue as a simple random walk, 
even after absorption, by giving the particles also a color, white or black. We 
start with all particles white, but absorption of the particle by the aggregate 
is now represented by changing the color of the particle from white to black 
at the time of its absorption. However, the particle's path is not influenced 
by its color. After a particle turns black, it continues with a continuous-time 
simple random walk path. A black particle has no interaction with any other 
particle, nor does it influence the motion of R(-). Thus, R is not increased at 
a time t when a black particle jumps to R(t). In the sequel, we shall always 
use this description of the system with colored particles. 

N(i,t) denotes the number of white particles at the space-time point 
(i,t). We successively define stopping times and take R(t) = k on the 
time interval [t^t^i). Moreover, it will follow by induction on k that 

(1.1) at time r^, there are no white particles in [0,i?(Tfc)] = [0,k]. 

We take To = 0. If and the N(i,Tk) have been determined, and R{rk) = k 
and (1.1) holds, then we take 

(1.2) Tfc_|_i = 'mf{t > Tk :some white particle jumps to position i?(r^) = k}. 
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Since the particles perform simple random walk and (1.1) holds, only white 
particles at position k + 1 at time Tt+i— can jump to k at time Tk+i- If 
such a jump occurs, we take Rfa+i) = k + 1 [i.e., R(-) jumps up by 1 at 
time 7fc_j_i] and change to black the color of all white particles which were at 
R(T~k) + 1 = k + 1 at time t^+i— (this includes the particle which jumped to 
k at Tfc_|_i). It is clear that then (1.1) with k replaced by k + 1 holds so that 
we can now define etc. It also follows from this description that 

(1.3) R(t) = k for T k <t<T k +i. 



Remark 1. We briefly indicate in this remark how our process can be 
constructed as a Markov process with the strong Markov property. However, 
anyone willing to accept the strong Markov property without proof will want 
to skip such a construction. 

As our sample space, we take 

oo 

O:=n^([0,oo),Z + ), 

i=i 

that is, the countable product of cadlag paths from [0, oo) to the nonnegative 
integers. All our random variables are functions on $7. We start with a count- 
ably infinite number of particles, which we order in some way as pi,p2, 

At the sample point (o>i, CO2, ■ • •) £ £7, the ith coordinate, Wj, is the path of the 
particle pi. The starting positions, Wj(0), of the various particles are specified 
by the initial point of our process and the displacements {coi(t) — tOi(0)}t>o, 
i = 1,2,..., are i.i.d. simple continuous-time random walk paths. Thus, a 
sample point specifies the positions of all particles at all times. The colors 
of all particles at any given time t and R(t) are then also determined, but 
we do not attempt to write down an explicit expression for these random 
variables. If Y (t) is the state of our process at time t, then Y(t) is a point of 
E, which is the collection of all sequences {r, (rii,r]i),i > 1} with r, rij 6 
and r\i G {W, B}. Y(t) = {r, (nj,r/,,),i > 1} means that R(t) = r and the po- 
sition and color of pi are rii and r/i, respectively. Of course, the process of 
the i.i.d. paths of the particles pi, 1 < i < 00, is a Markov process and this 
makes {Yt} also into a process with the simple Markov property. However, 
we have to allow the possibility of explosion; we must add a cemetery point 
d to our state space to define Y(t) as a Markov process for all time t. We do 
not know whether this alone will make {^(i)} into a strong Markov process 
which can start at each point in S. We shall therefore choose a smaller state 
space than S. 

Explosion can happen in two ways. First, Too := h m fc-»oo T k may be finite. 
Second, it may be that Tk+\ = Tfc. This happens if and only if at some time 
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t, there are infinitely many white particles at R(t) + 1. We do not want to 
continue our process after such a time. In fact, we shall not continue our 
process beyond the time 

t = inf{t : there are infinitely many particles of any color at some site z}. 

Let P a denote the measure governing the process {Y(t)} conditioned to 
start at a. We then choose as our state space for {Y(t)} the set 

S := {a € S : P a {? At 00 <co} = 0}. 

This description of the state space is rather indirect, but one can now prove 
that if the process starts at a point a € So, then it does not explode 

and stays in So for all time a.s. [P a ]- Moreover, the restricted process has 
the strong Markov property. Finally, Sq is nonempty. If the starting point 
a is chosen by taking 

R(0) = and all particles initially white and N(i,0),i > 1, 

(1.4) 

as i.i.d. Poisson random variables with mean fj,, 

then a lies a.s. in So- 

We shall not prove any of these statements here. Proofs can be given 
in the same manner (but actually simpler) as in Section 2 of Kesten and 
Sidoravicius (2003b). The principal step which makes this proof work is 
showing that for any a E So, any L, T > and e > 0, one can find a K > L 
such that 

P^jsome particle which starts in [K + l,oo) enters [0,L] during [0, T]} < e. 

The same is true if the initial state is chosen as in (1.4). 

Let us now state our results. Throughout, denotes the origin and {S(t)}t>o 
is a continuous-time simple symmetric random walk on Z with jump rate D. 
Unless otherwise stated, S(0) = 0. We use P{A} for the probability of the 
event A in various probability models and E for expectation with respect to 
P. It should be unambiguous from the context which probability measure 
we are discussing. Cj will denote a constant with value in (0, oo). Its value 
may vary from formula to formula. Our first theorem states that for any 
value of fi, the common expectation of the N(k,0), it is the case that 

(1.5) limsup —R(t) < oo a.s. 

t^oo t 

Theorem 1. Assume that R(0) = and that the N(i,0),i > 1, are i.i.d. 
mean-fi Poisson variables. Then (1.5) holds. In fact, there exist constants 
< Cj < oo such that 



(1.6) 



P{R(t) > dt} < C 2 exp[-C 3 t]. 



G 



H. KESTEN AND V. SIDORAVICIUS 



Remark 2 . Theorem 1 remains valid if the particles perform an asym- 
metric simple random walk, that is, each jump of the random walk is +1 
or —1 with probability p + and p- = 1 — p+, respectively. No change in the 
proof is required for this more general case. 

In view of Theorem 1, it is reasonable to conjecture that lim^ 00 (l/t)i?(t) 
exists and is constant a.s. One might even assume that this limit is strictly 
positive, but a quick (and quite general) argument in the next theorem shows 
that if /x < 1, then "there are not enough particles around" to make R(t) 
grow linearly with time. 

Theorem 2. Assume that {iV(i, 0)}j>i is a stationary ergodic sequence 
and that E{N(i,0)} = fi. I/O < /j,< 1, then 

(1.7) lim - R ® = a.s. 

t^oo (logt) 2 ^ 

Moreover, R{t)/y/t, t> 1, is a tight family, that is, 

(1.8) P{R(t) > xy/i} — > as x — > oo, uniformly in t > 1. 

If we assume that the initial conditions satisfy (l-4)> then (1.7) can be 
strengthened to 

, \ , R{t) 

(1.9) hmsup — -=~ < oo a.s. 

t-^oo v t 

Remark 3. One can formulate a (i-dimensional analog of our model and 
of Theorem 2. In this version, one works on Z rf and at time 0, the aggregate 
consists of the origin only, while at the site x/O, there are N(x,0) particles, 
with the N(x,0), x S T, d \ {0} i.i.d. Poisson variables of mean fi. Again, all 
particles perform independent continuous-time simple random walks. They 
all start out as white particles. We denote the aggregate at time t by A(t). 
If, at some time t, a white particle jumps from a site x ^ A(t— ) onto the 
aggregate, then we set A(t) = A(t—) U {x} and all particles which were at x 
at time t— are changed to black at time t. 

We define an outer radius of the aggregate by 

R {o ^ :=sup{||x|| 2 :xEyl(t)} 

and an inner radius as 

R^ d \t) :=mi{\\x\\ 2 :x(£A{t)}. 

The latter is the distance from the origin to the nearest vertex outside A(t). 
For this model Theorem 1 remains valid. More precisely, (1.6) and (1.5) with 



ONE-DIMENSIONAL DLA 



7 



R(t) replaced by R^°' d \t) still hold. Theorem 2 has the following analogue: 
if fx < 1, then 

, , , RM(t) 

(1.10) limsup -= — < oo a.s. 

t^oo yt 

[Note that (1.10) is trivially true if there exists a site xq which is never 
occupied by -A(i).] We shall not give the proofs of these results here. They 
are essentially the same as for Theorem 1 and for (1.9). 

If we strengthen our assumptions on the N(i,0), then we can show that 
in the one-dimensional model, R(t)/y/t is actually bounded away from in 
distribution. This holds for all fi > 0. 

Theorem 3. Assume that the N(i,0), i > 1, are i.i.d. with finite second 
moment fi% > 0. Then, for all e > 0, there exists an r] = 77(e) > and a 
to = ^o( £ ) such that 

(1.11) p|^>77|>l-e for all t> to. 

Unfortunately, the simple proof of (1.7) breaks down when /j > 1 and we 
therefore conjecture that there exists a critical value \i c > 1 such that 

lim —R(t) exists and is a.s. a constant which is { ^ »' ^ ^ 

t^oo t y = 0, it fj, < n c . 

(1.12) 

A stronger conjecture would be that 
(1.13) H C = 1. 

Simulations certainly indicate that this is the case; see Figures 1-3 which 
plot log[(l/n) J22=i Ri(t)] f° r various values of n,t, as a function of logi, 
where R\,...,R n are independent copies of R(t). We nevertheless marked 
the vertical axis as log ER(t) because we regard (1/n) J2i=i Ri(t) as an ap- 
proximation of ER(t). 

We have made only little progress toward proving (1.12), so we pose this 
as a problem. 

Open problem 1. Prove (1.12) and, if this holds, determine ji c . If one 
becomes even more ambitious, one can ask whether power laws exist as 
fi I \x c and what the critical exponents are. To formulate this problem, we 
have to assume that limi_» £X ,(l/t)i2(t) exists. Let us write Z(fi) for this limit. 

Open problem 2. Does 

log Z(fi) 



lim 



nine log (/j - /J, c 
exist and if so, what is its value? 




Fig. 1. Graph o/log[(l/n) ^. =1 iii(t)] against log t when /i = 0.5 and n — 1000 (at least 
for part of the graph). The iij(-) are independent runs of the process. The slope of the 
regression line is 0.503. The theory predicts a slope of 0.5. 



B 




o ■ t * 



_2 I ■ ' 1 ' ' 1 

4 5 12 

log t 

Fig. 2. Graph o/log[(l/n) against \ogt when — 1 and n — 1000. The slope 

of the regression line is 0.664- 



A final problem about the DLA model is motivated by Theorems 2 and 

3. 



Open problem 3. Does t~ l l 2 R(t) have a limit distribution as t — ► oo 
when /x < 1? It has been suggested to us that this problem could perhaps 
be handled by means of the techniques for establishing a hydrodynamic 
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limit result for R(t). Because of ignorance, we have made only a weak and 
unsuccessful effort in this direction. 

The obvious approach to proving that R(t) grows linearly in t is to study 
our system as seen from the right edge of the aggregate. Indeed, the collection 
of positions of the white particles relative to R(t) forms a Markov process. 
Does this Markov process have a nontrivial invariant probability distribution 
and, if so, is the invariant distribution unique? (By "nontrivial," we mean 
that we exclude the distribution which puts no particles at all to the right of 
the aggregate.) On an intuitive level, one would like to say that the invariant 
measure puts at position R(t) + x roughly a Poisson number of particles with 
mean equal to fx times the probability that a particle at R(t) + x is white. 
That is, the mean number of particles at R(t) + x should be lim^oo ^iv{x, t) , 
where 

v(x, t) = P{R{t) +x- S(s) > R(t - s) for < s < t}. 

Actually, all we want to know in first instance is that the density of white 
particles directly in front of R(t) is bounded away from as t — > oo. We 
want to show that the system does not develop large holes without white 
particles in front of R(t). To obtain such a result, we need some a priori 
control of R(t) — R(t — s), which we do not know how to control. T. Kurtz 
(private communication) showed us that, conditionally on the cr-field gen- 
erated by {R(s) :s < t}, the N(R(t) +x,t) have a Poisson distribution with 




togt 

Fig. 3. Graph o/log[(l/n) ^™=i a g a ^ ns t logi when [i = 1.1 and n = 100. The slope 

of the fitted curve approaches 0.999 as t becomes large. 
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a mean /i(x,t), say, even derived a system of differential equations for the 
fj,(x, ■). Unfortunately, this system still involves the unknown random func- 
tion R(-) in boundary conditions and we have been unable to make use of 
these differential equations. 

Since we were unsuccessful in proving the existence of a nontrivial invari- 
ant probability measure for the Markov process of the last paragraph, we 
designed some caricatures of the model. We hope that these caricatures can 
be regarded as "approximations" to the true model and will help us to treat 
the true model. These caricatures have built-in mechanisms that make it 
more difficult for a large hole to form in front of the aggregate. 

Caricature I. In this version, we still have an aggregate A(t) = [0, 
fi(i)]nZ. At time 0, we again put N(i,0) white particles at i, with {iV(i,0)}, 
i > 1, an i.i.d. sequence of mean-^t Poisson variables. In addition, we add 
J particles to the system at some deterministic positions x\ > 1, . . . ,xj > 
1. Again, the right edge of the aggregate [i.e., R(t)] will increase at the 
successive times at which a particle jumps from R{t^—) + 1 to R{rk—)- 
As before, at such a time, R(-) increases by 1 and changes to black the 
color of all the particles at R(Tk~ ) + 1. Equation (1.3) again holds in this 
caricature. The difference between this model and the true one is in the 
motion of the particles, or rather in the time at which the particles start 
moving. This can be described by introducing another color. At the start, 
only the J additional particles placed at x\,...,xj will be white. The other 
particles [N(i, 0) of them at position i] will be colored red. Red particles do 
not move. Once a particle turns white or black, it performs a continuous- 
time simple random walk, as in the true model. These random walks are 
independent of each other. A particle changes from red or white to black 
when it is first at position k at time r^— for some k. At all times, there will 
be exactly J white particles in the system. If, at time r^, m white particles 
change to black, then we replenish the system by changing m red particles 
to white, which then begin their random walks. To complete the description, 
we have to specify how the m red particles which become white are chosen. 
We will pick these as close to the right edge as possible. That means that 
at time we first change particles at k + 1 from red to white. If there are 
at least m red particles at k + 1 at time r^— , then we change exactly m of 
these to white and no other red particles turn white at this moment. If there 
are m\ < m red particles at k + 1 at time r^— , then we change all mi of 
these red particles to white. We then look for m — mi red particles at k + 2. 
As before, if there are ni2 red particles at k + 2 and m?, > m — mi, then we 
turn exactly m — mi red particles at k + 2 into white and do not change any 
further red particles to white. If m2 < m — mi, then we change all ni2 of 
the red particles at k + 2 to white and we still need to change m — mi — m<i 
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particles. We now search for these at k + 3, etc., until we have changed m 
red particles to white. 

This version indeed has some of the desirable properties. Equation (1.5) 
still holds for this model. In fact, since, at any time, there are only J white 
particles present in the system, the rate at which R(-) jumps is at most 
JD/2, so 

(1.14) limsup--R(i) < — a.s. 

t— »oo t 2 

Furthermore, if < fM < 1, then (1.7) and (1.8) hold for this caricature. No 
essential changes in the proof of Theorem 2 are needed for these. It is, 
however, not clear whether (1.11) holds when n < 1. Most importantly, we 
can show in this model that there exists a Jo such that if J > Jq and \i > 2 J, 
then 

(1.15) lim —R(t) exists and is strictly positive a.s. 

Thus, there is a phase transition in the large-time growth rate of R(t) in 
this model. 

Unfortunately, the proof of (1.15) for this caricature is still rather com- 
plicated. Since this is only a caricature, we shall not give this proof, but 
instead treat a simpler caricature, one which is a bit further removed from 
the true model. 

Caricature II. This caricature corresponds more or less to Carica- 
ture I with n = oo. That is, we start with infinitely many red particles at 
each % > 1, plus J additional white particles at x\,...,xj. Everything but 
the choice of which red particles to turn into white ones is as in Carica- 
ture I. However, if at time Tf~, m red particles have to be turned into white 
ones, then we select these at positions k + Y%,k + Y%, ■ ■ ■ ,k + Y m with the 
Yi, . . . , Y m i.i.d. with some common distribution G, where G is concentrated 
on {1,2,...}. In Section 4, we shall show that if J is large and G has a 
suitable number of moments, then (1.15) again holds for this caricature (see 
Theorem 4). Also, (1.1) still holds in this model. 

The reason why this caricature is relatively simple to treat is that the 
positions of the J white particles (as seen from the front of the aggregate) 
form a Markov process with a countable state space. There is a standard 
method to prove positive recurrence of such processes, namely to apply Fos- 
ter's criterion after finding a suitable positive supermartingale or Lyapounov 
function [see Fayolle, Malyshev and Menshikov (1995), Section 2.2]. This is 
indeed the method which we shall use in Section 4. 



12 



H. KESTEN AND V. SIDORAVICIUS 



2. A linear upper bound for R(t). 

Proof of Theorem 1. This proof is actually contained in the proof of 
Proposition 4 and Theorem 1 of Kesten and Sidoravicius (2005). However, 
in the special case with which we deal here, the proof simplifies and we 
can quickly show the principal step. Basically, this is a Peierls argument, 
in that it estimates the expected number of certain paths. For the proof of 
Theorem 1, it is convenient to label the particles in a different way than in 
Section 1. We shall order the particles at i at time in an arbitrary way 
and denote the jth particle at i at time by We say that exists 

if N(i, 0) > j. Then, if we take k = \Cit\ , 

P{R(t) > Cit} < P{r k < t} 



(2.1) 



< J J -P{some existing particle jumps 

0<t!<t 2 <---<t k <t 

from i to i — 1 during dti, 1 < * < k, 

and (ui,Vi),l <i< k, are distinct}. 

Note that the (ui,Vi) have to be distinct because a given particle can change 
from white to black at most once. As in (2.51) of Kesten and Sidoravicius 
(2005), the right-hand side here equals 

[D/2] k dh---dt k 

0<ti<t 2 <---<t k <t 



(2.2) 



x El[[I[(ui,Vi) exists]P{5(ti 

(ui,Vi) distinct i=l 



- J "J Ml 

0<ti<t2<---<tfc<t 

n k 



■dti 



Defit 



2k 



i + 1 -Ui}] 



D/j,- 


k 


Dfit' 


2 




2 



k\ 



The bound (1.6) with C\ 
C 3 = Cilog2. □ 



De/i now follows (recall that k = \Cit\) and 



We already stated in Remark 1 that min(f, t^) is almost surely infinite. 
Theorem 1 confirms that [under (1.4)] Too = oo. The next lemma confirms 
that also r = oo. We show the short proof [which is also part of the proof 
of Proposition 4 in Kesten and Sidoravicius (2005)] because some of the 
computations in the proof will be needed again in the next section. Define 

a s (z)=P{S(s) = -z}. 
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Note that 



(2.3) a s+u (z) > e Du a s (z) and a s+u (z) > a u (z')a s (z - z') 
for any z,z' £Z and that 



a s (y - z)ds 



o 



= ^{amount of time spent by S{ ) at z during [0, t + 1]|5(0) = y} 



(2.4) > P{y + S(s) reaches z at some s < t 



and stays at z at least one unit of time} 



> e P{y + 5(s) = z for some s < t}. 

Lemma 1. Assume that the N(i,0), % > 1, are iid. mean-fj, Poisson 
variables. Then r = oo almost surely. 

PROOF. For any t > 0, z G Z, 

£'< supA r (z,s) > < -Ejnumber of particles which visit z during [0,t]} 



= He D (t + l) < oo. 
Thus, P{N(z, s) = oo for some z € Z and s < oo} = 0. □ 

3. A sublinear upper bound for R(t) when /Lt < 1. In this section, we 
show that R(t) cannot grow linearly with t when \l < 1. This results requires 
far less than (1.4), as shown in Theorem 2. If (1.4) is assumed and fi < 1, 
then Theorems 2 and 3 show that -R(£) is of order 

Proof of Theorem 2. Define 

U (t) = (number of black particles in the system at time t) 



V(r,t) = (number of particles which moved into [0, r] during [0, i]). 



s<t 



< 22 ^Piv + S( s ) = z f° r some s < t} 




[by (2.4)] 



and 
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Note that V(r,t) only counts particles which were outside [0,r] at time 
and that a particle does not have to be in [0, r) at time t to be counted in 
V(r,t). A particle can be black at time t only if it started in [0, r] or if it 
coincided with R(s) at some time s <t. Therefore, one has, on the event 
{R(t)=r}, 

r 

U(t)<J2N(i,0) 

i=0 

(3.1) + (number of particles which moved into [0, r] during [0,t]) 

r 

= J^N{i,0) + V{r,t). 

i=0 

On the other hand, we must have 

(3.2) U(t) > r 

since at least one new particle turns black at each time when R(t) increases 
by 1. Thus, still on {R(t) = r}, 

r 

(3.3) r<5^JV(i,0)+V(r,t). 

i=i 

Now, if the N(i,0) form a stationary ergodic sequence with common mean 
fj,, then 



J2 0) = pr + o(r) < [// + (1 - fi)/2]r 

i=0 

for r > some (random) tq almost surely. Thus, for such r, 

i(l-//)r<FM). 

Now, the event {-R(i) > A} (with A a positive integer) can occur only if, for 
some s < t, R(s) = A. Therefore, for such an s, 

{R(t) >A}C{A< r } U | A < -JL--V(A t a)} 



(3.4) 



c{A<ro}u{^<-4^y^^)}- 



Now, let us estimate E{V(A,t)}. This is the expected number of parti- 
cles which start in [^4 + l,oo) and which enter [0,A] during [0, £]. Thus, for 
suitable constants < Q < oo, independent of A, and t > 1, 



E{V(A,t)}= E{N(i,0)}p{mm + S(s)]<A\ 
i>A+l 
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OO s 

» E P { l ^t s{s) - A 



(3.5) 



i=A+l 



iexp 



-C 5 



/: 2 



[e.g., by the inequality (2.42) in Kesten and Sidoravicius (2003a)] 

<c 3 Vt. 

Consequently, 



(3.6) 



P{A< 



In particular, we obtain for t = 4 k and ^4 = [e/c 2 2 fc ] , that for any fixed s > 0, 

Thus, by Borel-Cantelli, almost surely ^ 2 ^ V(ek 2 2 k , 4 fc ) < |~e/c 2 2 fc ] for all 

large fc. Also, ek 2 2 k > ro for all large /c almost surely. (3.4) now tells us that 
almost surely, 

R(A k ) < \ek 2 2 k ], eventually. 

Since R(-) is nondecreasing, this implies (1.7). 

The tightness in (1.8) follows in a similar way from (3.4) and (3.6). 

If (1.4) holds, then V(A,t) is actually bounded by a Poisson random 
variable with mean at most 

E{N(i, 0)}P<[inf [i + S(s)] < A j = fi W inf S ( s ) < -»} < 
i>A+i > i>i > 

If we then take t = 4 fc and A = A k =: [AC%/(1 — jj)]2 k , we get, instead of 
(3.6), 



p{v{A k A k )> 



(l-(i)A k 



< exp 



--(l-^)A k + (e e -l)C 3 2 k 



for any 9 > 0. In particular, if > is taken such that e e — 1 < 39/2, then 
we obtain 



P 



[v(A k ,4 k )>V-^ 



< exp 



--C 3 2 fc 
2 



Thus, in this situation, a.s. F(A fc ,4 fc ) < (1 - n)A k /2 and R(4 k ) < A k , even- 
tually, and (1.9) follows from the monotonicity of R(-) as before. □ 
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Proof of Theorem 3. We shall give a proof by contradiction. Let 
e > be given and assume that (1.11) fails for this e. There then exists 
some sequence t n — ► oo such that for all rj > 0, 

(3.7) pf^pl>rj\ <l-e for all large n. 

This, together with the monotonicity of R(-), implies that for all < 7 < 
1, 77 > and large enough n, 

In order to choose 7 and 77, we need some preparations. Fix a > such that 

pjinf 5(a) < -2^ > a for all t > 1. 

Such an a > exists by the central limit theorem. Define 

W(t) = (number of particles which start in [Vt, 2y/i] 

at time and reach the origin during [0, t]). 

Then each particle which starts in [\/t, 2y/i\ at time has a probability 
of at least a of reaching the origin during [0,t]. Thus, conditionally on 
^ie[Vt 2y/t] -^(*> 0) = N } W(t) is stochastically larger than B(N,a), where 
B(N,a) is a binomially distributed random variable corresponding to N 
trials, each with success probability a. In particular, 

P{W(t) < \a^Vt] <p\ N & °) ^ } 

+ P{B(l(iy/i,a) < ±afiVi}. 

By simple weak law of large numbers estimates (i.e., Chebyshev's inequality), 
the right-hand side here tends to as t — > 00 so that for all large n, 

(3.9) P{W(t n )<\ayi^Q<l. 

We also define 

W(7,i) := (number of particles which start in [s/i, 2\fb] 

at time and enter (—00, \ \/t\ during [0,7*]) 

and let f3 be such that 

pjinf S(s) <-hVi] </3 forallt>l. 

[s<jt J 
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Then 

E{W(j,t)}< Y EN(i,0)p{ inf S(s)<-±Vi\ <(fiVi + 2)/3, 

where [i = EN(i,0). Note that we can take (3 arbitrarily small by taking 
7 small [by means of (2.42) in Kesten and Sidoravicius (2003a)]. We can 
therefore also fix 7 > and (5 correspondingly small such that 

(3.10) P{W(j, t n ) > |<WQ < \ 

for all large n. With 7 and (3 fixed in this way, we have from (3.8)-(3.10), 
for any fixed rj > and large n, that 



(3.11) 



l \/tn y/tfi 



W(t n ) > ^afiVt n and W(j,t n ) < ^a(iy/i^\ > |- 



For the remainder of this proof, t will always be restricted to belong to 
the sequence {t n }, even if we do not attach a subscript to t. We now define 

Cj = collection of particles which start in [v^, and which 
turn black at the jth jump of R(-) after time jt. 

We use \B\ to denote the cardinality of a collection B. We claim that on the 
event in the left-hand side of (3.11), we have 

R(t)-R(r/t) 

(3.12) \Cj\>(l/4:)afj,Vi. 

i=i 

Note that the jumps of R(-) in the time interval ('ytjt] are precisely the jth. 
jump after yt for some 1 < j < R(t) — R(yt). To see (3.12), note that any 
particle which reaches the origin during [0,t] must have coincided with R(s) 
for some s < t and must therefore be black at time t. In particular, this holds 
for the W(t) particles which start in [y/t, 2y/t] and which reach the origin 
during [0,t]. If we restrict ourselves to rj < 1/2, then, on the event in the 
left-hand side of (3.11), it is the case that R(s) < R(yt) < rj\/i < (l/2)\/i 
for s < "ft, so the particles which do not enter (—00, (l/2)\/i] during [0,^yt] 
cannot have turned black yet at time jt. Thus, on the event (3.11), we have 
at least W(t) — W(j,t) > (l/4)a[i\/t particles which start in [\/i,2\/i] and 
which turn black during (jt,t]. All these particles belong to some Cg with 
jt <i~e<t and are therefore counted in the left-hand side of (3.12) so that 
(3.12) follows. 
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Finally, we will show that we can choose 5 > such that 



(3.13) 



P< 



■R(t)-R(-Yt) 

E 

- 3=1 



\Ci\ 2 <5Vi } > 1 



Then the probability that the events in the left-hand sides of (3.11) and 
(3.13) both occur is at least e/4. However, on the intersection of these two 
events, we have, by (3.12) and Schwarz' inequality, 



R(t)-R(-yt) 

E 

3=1 



\c, 



R(t)-R(-yt) 

<[R(t)-R(jt)] Yl \Cj\ 2 < R(t)5Vt. 

3=1 



In particular, this implies that 

„. , a 2 u 2 r 

on the intersection of the left-hand sides of (3.11) and (3.13). This, how- 
ever, is impossible for rj < a 2 fi 2 /(lQ5) since one cannot simultaneously have 
R(t) < rjy/t and R(t) > a 2 \ft I (165) . Thus, the assumption that (1.11) fails 
leads to a contradiction. 

It remains to show (3.13). This will follow from a bound, on E{J^f=i 
|Cj| 2 }. Before we prove such a bound, we remind the reader of some basic 
inequalities. First, for some constant C\ < oo depending on D only, we have 

Ci 



S upP{S(s) = k}< 
k Vs + 1 



for s > 0. 



This follows from the local central limit theorem [see also the proof of 
Lemma 12 in Kesten and Sidoravicius (2003a) and Proposition 7.10 in 
Spitzer (1976)]. This estimate can be slightly refined. Indeed, for some fur- 
ther constants < d < oo depending on D only, it holds uniformly in k 
that 

P{S(s) = k} = Y, P{S(s/2) = £}P{S{s) - S(s/2) = k-£} 



Y, P{S(s/2)=£}P{S(s/2) = k-£} 

£<\k\/2 



< 



+ J2 P{S(s/2)=£}P{S{s/2) 

t>\k\/2 

Ci 



< 



^J2 + 1 

C 2 



k-£} 

P{S(s/2) S(s/2) > \k\/2}- 

exp -C 3 - 



k 2 



s + 



Ci 



V2 + 1 
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where, in the last step, we used (2.42) of Kesten and Sidoravicius (2003a). 
In particular, if 7r(£, s) denotes the position of a particle £ at time s, then 
for k>Q,jt<s<t and z € [\/t, 2\/i], 



P{vr(£, s) = k + l|7r(e, 0) = *} < exp 

(3.14) 



C 3 (* + l-*) 



2i 



t+\k + l-z\ 



< 



C 4 



cxp 



We turn to the proof of (3.13) proper. We start with the basic relation 

R(t)-R(rft) R(t)-R(jt) 

E \^\ 2 = E E 1 

j = l j = l pGCj 

R(t)-R(jt) 

= EE^t' 01 anc ^ both turn black at 

j = l pi P2 

time T R ^ + j when all 
(3.15) particles of Cj turn black 

and this happens during [7i,i]] 
= EE^ 1 anc ^ Z 32 turn black 

simultaneously at some time in (7i,i]]. 

Here, the sum over each pi is over all particles p which start in [\/t, 2\/i\ 
and which change color during (jt,t]. We denote the cr-field generated by 
the initial {N(i,0),i > 1} by Tq. We then have the following bound on the 
conditional expectation of (3.15), given the initial data: 



(R(t)-R(nt) 



(3.16) 

< EE^ 5 ^ 1 anc ^ *° 2 cnan § e color at the same time in ( i yt,t]\J r o}. 

Here, the sum in the right-hand side is over all p\ and p2 which start in 
[\/t , 2\/t] . After taking the expectation over the initial state, the contribution 

to E{J2f=i ^ 7< ^ \Cj\ 2 } from pairs with p\ = p2 is at most 
(3.17) WE 1 }^) E N(i,0)\<p(Vt + 2). 
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To handle pairs p± 7^ P2, define R r (s; p\) and R r (s; p\,p2) to be the values 
of R(s) in the system from which pi, respectively p\ and P2, have been 
removed at time 0. Now p\ and P2 may change color simultaneously in ds 
in three ways: (i) P2 jumps during ds from R r (s—; p\) + 1 to R r (s—;pi) and 
pi is at R r (s—; p\) + 1 at time s— and then changes color at the time when 
P2 jumps and R r (-;pi) increases by 1; (ii) the scenario in (i) with the roles 
of pi and p2 interchanged is followed; (hi) some white particle P3, different 
from pi and P2, jumps during ds from R r (s— ; pi, P2) + 1 to R r (s— ; pi, P2), 
and pi and P2 are at R r (s—; p\-,P2) + 1 at time s— and then change color at 
the time when p^, jumps and R r (-; pi, P2) increases by 1. 

Now, observe that for p\ / p2, R r (-;p\) and 7r(p2r) are independent of 
the path of p\. Therefore, the conditional probability of (i) taking place, 
given To , and for a given p\ , p2 with p2 7^ p\ which start in \\ft , 2\/t] , is at 
most 



E 

fc>0 



It 



P{R r (s-; Pl ) 



k. 



7r(p2,s—) = k + 1 and P2 is white at time s- 
x P{n{pi,s-) 



l^o} 



(3.18) 



, D 
k + l}—ds 



< W P{R r (s-, P i) 



7T(p2,S- 

C A D 



cxp 



A:, 



k + 1 and P2 is white at time s- 



t + k 



ds 



[by (3.14)]. 



We now sum this first over the P2 7^ pi which start in [y/t, 2yt\. For fixed pi 
and k, the events that R jumps from k to k + 1 due to a jump of P2 in ds 
are disjoint for different P2 and s. Therefore, the sum of (3.18) over p2 and 
integral over s is at most 



C A D 



(3.19) 



/ P{R r (-; pi) jumps from k to k + 1 during ds due to 
a jump of some particle other than pi} 

" C,k 2 

x exp 



< 



CjD 



E ex P 



fc>0 



t + k 



C R fc 2 



t + k 
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Now, taking the sum over k and pi and taking the expectation over the 
initial state, we find that the contribution to E{J2f=\ r (t*) |Cj| 2 } coming 
from scenario (i) is at most 



(3.20) 



CaD 



E 

k>0 



cxp 



C,k 2 



t + k 



E\ J2 N(i,0)\< 



cWi 

V7 



for a suitable constant Cq. By interchanging the roles of pi and p%, we get 
the same contribution from scenario (ii). 

The contribution from scenario (iii) can be estimated similarly. For fixed 
distinct p\ — p^, we now replace (3.18) by the bound 

£ f P{R r ( S -, Pl ,p 2 ) = k, 



(3.21) 



7r(p3, s— ) = k + 1 and p3 is white at time s— |JT } 
x P{vr(pi, s-) = 7r(p 2 , s-) = fc + 1} ^ ds 

< P{in system without pi, p2, R r {-; pi, P2) increases 

' 2 ^ ^0 



x exp 



from k to A; + 1 by 1 due to jump of psl^o} 



2C5A; 2 



t + k 



Analogously to (3.19), the sum of the right-hand side of (3.21) over p^ is at 
most 

C 2 A D ^ r 1C h k^ . C 7 



2 7 t 



^ exp 



fc>0 



t + k 



< 



After summing over those pi, pi which start in [y/i,2y/i] and taking expec- 
tation over the initial state, we find that scenario (iii) contributes at most 

1 2' 



cv 



E< 



E 



<^Vt 

7 



to E{J2f=l fl(7t) |Cj | 2 }. Adding this to the contributions in (3.17) and (3.20), 
we find that 

(3.22) 



R(t)-R(-yt) 



A E 



\Cj\ 2 



3=1 



7 



Thus, (3.13) with 8 = iCg/^e) follows from Markov's inequality. □ 
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Remark 4. Consider the system in which all particles perform asym- 
metric random walks, as described in Remark 2. Assume that < p + < 
1/2 < p- < 1 so that the particles have a drift to the left. It is intuitively 
clear that in this case, R(t) should go to infinity at least linearly in t. In 
fact, by Remark 2 it cannot grow faster than linearly in t. It is possible to 
prove that there exists a constant Cio > such that 

(3.23) liminf-J?(t) > Cio = C w (p+) a.s. 

To prove (3.23), we use the same "second moment method" as in the 
proof of Theorem 3. To be precise, we use the following analogues of (3.12) 
and (3.22): this time let Cj be the collection of particles which turn black at 
the jth jump of R(-). Then for 

R(t) 

(3.24) 52\Cj\>C n t 



and 



R(t) 

(3.25) Y^\Cj\ 2 <Ci2t. 

i=i 

If both these relations hold, then by Schwarz' inequality, as in the proof of 
Theorem 3, 

C 2 

(3.26) C\ x t 2 < R(t)C 12 t, whence R(t) > -P~t. 

t>12 

Now, (3.24) is trivial since all white particles have a drift (p_ — p+) toward 
the origin. Thus, the number of particles which reach the origin during [0,t] 
is at least 

E iV(*,0)>^V-p+)t, 
l<x<(p--p+)Dt/2 

outside an event of exponentially (in t) small probability. Again as in the 
proof of Theorem 3, all these particles will have coincided with the right 
edge of the aggregate and have changed color by time t, and are counted in 
J2j<R(t) Thus, (3.24) with C\\ = fj,D(p- — p+)/4 holds for all large t, 
a.s. 

To prove (3.25), we need much of the machinery developed in Kesten and 
Sidoravicius (2003a) and we do not give this proof here. 
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4. Positive recurrence in Caricature II. In this section, we consider Car- 
icature II, as described at the end of the Introduction. We denote the loca- 
tions at time t of the J white particles relative to R(t) as Xi(t),X2(t), . . . , Xj(t). 
We stress that these are the relative locations with respect to R(t). The ac- 
tual locations of the white particles in Z + are R(t)+ X\ (t) , . . . , R(t) + Xj (t) . 
The process can be constructed in the following way. Let {S(t)} t >o and 
{Sj(t)}t>o, 1 < j < J, be i.i.d. continuous-time simple random walks which 
start at and have jump rate D. Also, let {Yj tk , 1 < j < J, k > 1} be i.i.d. 
random variables with common distribution G, concentrated on {1,2,...}. 
The {Yj^} are taken independent of the {Sj(t)}. Let i?(0) = 0,tq = and 
Xj(0) = Ajfi £ {1,2, . . .}, l<j<J. These Xj(0) are regarded as nonran- 
dom, but are otherwise arbitrary integers > 1. Then, when r k and Xj(r k ) 
have already been determined for some k > 0, define 

(4. 1) r k+1 = wf{t > T k : Xj (r fe ) + [S3 (t) - Sj {r k )} = for some 1 < j < J} 

and let r(k + 1) be the value of j for which Xjfa) + [Sjfa+i) — Sjfa)} = 0. 
Since almost surely only one of the random walks jumps at any time t, this 
index r(k+ 1) is a.s. unique. S^+i) is the a.s. unique Sj which has a jump 
at time Tk+\- Further, let 

(4.2) Xj (t) = Xj (r fc ) + [Sj (t) - Sj (r fe )] for r k < t < r k+1 ,l<j<J 
and 

(4.3) Xj(T k+1 )=Xj(T k+1 -)-I[j = r(k + l)]+A jtk+1 , 1 < j < J, 
where the so-called adjustments are defined by 

(Y r{k+1)jk+1 , \£j = r(k + l), 

(4.4) Aj M1 = { Y jtk+1 - 1, if Xjfa+i-) = h but j + r(k + 1), 

l-l, HXj(r k+1 -)>2. 

Note that a jump of a simple random walk is +1 or —1, so the X r r k+ i^, 
which jumps to at time r k+ \, must satisfy 

(4.5) X r(fc+1 )(r fc+ i-) = 1. 

Thus, the adjustments have been defined in such a way that 

(4.6) Xj(t) = Sj(t)+ J2 A i,k- 

k>0:r k <t 

R(t) is defined by (1.3). We point out that we make no adjustments at time 
0, but start with the nonrandom Xj(0) =^4^0) nn d Xj(n) from (4.1)-(4.3) 

and then find Xj(r k ) successively for k = 2, 3, 

The preceding paragraph almost surely defines the Xj for all time. It is 
clear from the description of the model that the (ordered) J-tuple {X\ (t), . . . , 
Xj(t)}t>o is a strong Markov process. Its countable state space is {1, 2, . . .} J . 
In a sequence of lemmas, we shall prove the following theorem. 
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Theorem 4. Consider Caricature II. If 

oo 

(4.7) mo := 5> 10 G({n}) < oo, 

n=l 

then there exists a Jq such that for all J > Jq, {Xj(t),l < j < J}t>o is 
irreducible and positive recurrent. Moreover, under condition (4-7) and J > 
Jo, it holds almost surely that 

R(t) 

(4.8) lim exists and is strictly greater than 0. 

t~^co t 

We need more notation. £\{t), . . . ,£j(t) will be the values X\(t), . . . ,Xj(t) 
in increasing order, so 

(4.9) h(t)<e 2 (t)<---<£j(t). 
We set L = L = ^i(O) + • • • + £j(0) and 

L k :=£ 1 {T k -) + --- + £j{T k -)-l, k>l. 

The values in the right-hand side here are the values of the £j "just before 
the r(k)th particle has jumped at time r k and before the adjustments at r k 
have been made." For later use, we note that 

(4.10) £j(r k -) > 1, 1 < j < J, and L k > J - 1 
because each Xj(t) > 1. We also define the J- vectors 

(4.11) U k :=(X 1 fa-),...,Xj(n-)) 
at this time. The values after the adjustments give us 

J 

L k := £i{r k ) + ■■■+ £j{r k ) = L k + ^ A j)k . 

3=1 

We further define 

A = A(a) = |(xi, . . . ,xj) :xj G {1,2, . . .}, < a + l|, 

Vl = Vl (a) = m.i{k >l:U k e A(a)} = inf{A; > 1 : L k < a} 

and 

v n+1 = v n+ i{a) = mi{k >v n :U k £ A(a)}. 

We can now outline the proof of Theorem 4. The J-vectors U k , k>l, form 
a Markov chain with the countable state space 

r := |(xi,x 2 , • • • ,xj) :xi G Z + ,minxj = l|. 
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The minimal coordinate of any Uk = minjXj(rfc— ) must equal 1 because a 
particle can jump to at time only if it is at 1 just before the jump. 
The Markov chain {Uk} visits the finite set A(a) successively at the times 

vi,V2, It is not hard to prove that the chain {Uk} is irreducible (see 

below) and, in fact, even the embedded Markov chain {U Ui }i>\ is irreducible. 
The latter has the finite set T n A as state space and therefore has a unique 
invariant probability measure, p, say, on T n A. We shall prove that under 
condition (4.7), and for J > Jo for a suitable Jo < oo, for any choice of the 
initial state (Xi(0), . . . ,Xj(0)), we have 

(4.12) vi < oo a.s. and E{v 2 } < oo, 
and 

(4.13) t U2 < oo a.s. and E{t U2 } < oo. 

Let us write E p for the expectation when the Markov chain {U Vi } starts 
with the distribution p for U Ul . We shall prove that (4.12) and (4.13) also 
imply that 

(4.14) E p {v 2 -v\} <oo 
and 

(4.15) EP{t V2 -t vx }<oo. 

It then follows from the law of large numbers for Markov additive processes 
that 

1 < lim — v n = E p {v2 — v{\ < oo and 

(4.16) ^ 

< lim — t v = E p {t U2 -t Ui }< oo. 

n— >oo n 

A proof of (4.16) can easily be given by a slight generalization of Chung 
(1967), Theorems 1.15.1 and 2. One must apply the argument there to the 
Markov chain {U Ui } with the deterministic function /(•) in Chung (1967) 
replaced by the random function [fj+i — Vi] for (4.14), or r„ i+1 —T Vi for 
(4.15). 

It follows from (4.16) that 

n . ,. Vn EP{V 2 - V X } 

U < lim = lim = —— < oo. 

n ^°°r Un+1 n^oo Tvn Ep{t V2 -t Vi } 

But, for r Un < t < T„ n+1 , it holds that v n < R(t) < v n +i [see (1.3)] and 

R(t) V n +1 
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so that a.s. 

(4.17) 0<limM = f ( ^--> <oc. 

t-oo t EP{T U2 -T U1 } 

This will prove (4.8). 

To start on the details, let us take care of the irreducibility of {Uk} and 
{U Vi }, and the proof of (4.14) and (4.15) from (4.12) and (4.13). Let x' = 
(xi , . . . , x j) and y = (yi,---,yj) be points in T. Assume, without loss of 
generality, that y\ = 1. Suppose U\. = (x^, . . . , x'j) at time r^— and that after 
the adjustments at time r^, (X^r^), . . . , Xj(r^)) = (x'/, . . . ,x'j) with x" > 1, 
1 < i < J. It is clear that the random walks Si, 1 < i < J, can then move from 
x'l to yi, for 1 < i < J, in such a way that + Si stays > 1. Suppose that this 
happens over a time interval [7fc,Tfc + s) so that Xifa + s) = y^, 1 < i < J. 
Assume that the next jump of some Xi occurs at time + s + u and that 
it is X\ which jumps at that time from Xifa + s + u—) = y% = 1 to 0. 
In this case, r fc+ i = r fc + s + u and C/ fe+1 = (y 1 , . . . , yj) . Since (yx,...,yj) 
is an arbitrary point in T, this proves the irreducibility of the chain {Uk}- 
In fact, it proves that P{Uk+i = y\Uk = x'} > for any x',y £ T. We then 
automatically also have P{U Ul+1 = y\U Ui = x} > for any x, y G A C T. Thus, 
{C/;, t } is irreducible, as claimed. 

As for (4.14) and (4.15), these are not immediately obvious because we 
have treated X(tq— ) differently from the X{rk— ) for k > 1 by not applying 
any adjustments at time tq = 0. However, the preceding paragraph shows 
that if we start in any (nonrandom) state X(0) = x = (x±, . . . , xj), and y = 
(yi, . . . ,yj) G Tn A, then P{ui = 2,U 2 = y\X(0) = x} > 0. We then also have 

E{v 2 \X(0) =x}> E{u 2 - vi\X{0) = x} 

> P{^ =2,U 2 = y\X(0) = x}E{v 2 - ^\U Ul = y}. 

Thus, (4.12) implies E{v 2 — v\\U Ul = y} < oo for any j/STnA and this, in 
turn, implies (4.14), because there are only finitely many y in T n A. In a 
similar way, one deduces (4.15) from (4.13). 

We now start on the proof of (4.12) and (4.13). We define 

and the u-fields 

F(t) = cr-field generated by {Sj (s) : 1 < j < J, < s < t}, 

Gk = F{rk) V {Y j:n , 1 < j < J, n < k - 1}. 

Note that the Yj^ are not included in the set of variables which generate 
Q k . Thus, the information in Q k determines T k ,Xj(j\ z —') and L k , but not the 
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adjustments Aj± or the values of Xj^rj.), L^. The cr-field which also includes 
the information on Y~ 1 < j ' < J, is 

TCk ■= a-field generated by Gk V {Yj,k, 1 < j < J}- 

Throughout, Di will denote various constants with values in (0, oo) which 
are independent of J. The same symbol Di may have different values in 
different formulae. For an event A, I [A] denotes the indicator function of A. 
For real numbers a, b, we write a A b for min(a, b) and a V b for max(a, b). 

Lemma 2. Assume that 2q G {2, 3, . . .} and that p>0 is such that 

oo 

(4.18) J2 n 2q+p G({n}) < oo. 

n=l 

Then, for all e > 0, there exists a J{q,e) such that for all J > J(q,e) and 
k>0, it holds that 

(4.19) ^K[^(T fc )r|^}<e(^) 29 " 1 [X J (r fe -)]^. 

/For k = 0, we interpret Xj(tq—) as Xj(0) and J(q,e) will depend also on 
h ifk = 0.] 

Proof. We fix k and abbreviate £j(Tf.) to lj. For the time being, we 
condition on TCk and consequently regard lj, and also Lfc,Lfc, as fixed. The 
main part of the proof is to show that 

2q-l 



(4.20) E {5l\n k }<eh[-f 
The proof is based on the following well-known estimate: for x G {1,2, . . .}, 

(4.21) P{Sj(u) < -x} < ipjinf Sj(s) < -xj 

[see Doob (1953), proof of Theorem III. 2. 2]. This implies that 
P{xj + Sj(s) > for < s < u} 

= p{mfS,( S ) >!-*,} 

= 1 - p{ inf SAs) < -xA < 1 - 2P{Sj(u) < -xA 
= P{~Xj < Sj(u) < Xj } < 1 A — )J-, u > l,Xj G {1, 2, . . .} 



(4.22) 
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(by the local central limit theorem) . Since 5 k > u occurs if and only if Xj (t) = 
Xj(rk) + [Sj(t) — Sj(Tk)] > for Tfc < t < Tfc + u, for 1 < j < J, it follows that 



J r 



(4.23) 



1 A 



D 



p{s k >u\n k }<H 

For the remainder of this proof, we restrict ourselves to the case when q is 
an integer. The case when q is not an integer is actually easier. We set £q = 
and £ j + \ = oo and, without loss of generality, we assume J > 8q + 2 > 10. 
We further interpret the product t\ ■ ■ ■ £q as 1. Then (4.23) gives 



E{s q k \n k } = q / u q - x P{8 k > u\n k }du 

Jo 



<Q E h---ij[Di 

0<j<2q 



3+11 



(4.24) 



+ qtl 



;-Di&,+if 



U 



^l 2 du 



<D2 E 

0<j<2<? 



£f-£ j [£ j+1 . 
in 



u 1 du 

u~ 3/2 du 



Die 2q +i] 2 



+ D 2 £ 1 ---£ 2q \og^ + D 2 £ 1 



<D 3 h---£ 



2<? 



1+log 



2q 

hq+1 



<2q 



It further follows from 



<£■>< 



< 



«2g 

that 



(since h<£ 2 <---<£j). 



(4.25) £i<£ 2 <---< £ 2q +i < L k /(J - 2q) < 2L k /J for J > 4q. 
Substitution into (4.24) yields 



(4.26) 



E{5 q k \n k }<D 3 £ 1 ---£ 2q ^ 



J£ 



2<Z 



J£ 2 q 

L k 



+ 



+ 



Jl 



2q 



L k 

J£2q 



U 



log 
log 



2L k 

J£ 2q 

2L k 



J£ 



2q 



Now, fix < rj = 77(e) < 2/e such that 

D 3 \ 2q ~ 2 [A + A log(2/A)] < s for < A < r] 
and define the event 

r]L k 



2q 



< 



J 



(4-27) t^>±±>Mj- j + 1 )t.> 
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Note that Ak G ~Hk and that the desired inequality (4.20) certainly holds on 
the event Ak- 
in order to deal with the conditional expectation on the complement of 
Ak, we shall refine the estimate (4.24). First, we note that on Aj,, for all 
j < J/2, it holds that 

Thus, if we set D4 = (2/rj) V 1, then on A%, 

£j<D A £ 2q , l<i<J/2. 

For such £j,£ 2q , there exists, for each £ > 0, some /(C) = f(Ci £ ) > such 
that 

+ S,(i) > for i < [C^i^] 2 } < P{5([CDi^] 2 ) > -D 4 £ 2q } 

(4.28) 

< 1-/(0, l<J<J/2. 

We shall soon fix a number £ S (0, 1), but we need some inequalities before 
we can do so. If < ( < 1 and £ 2q ~i,£ 2q are such that C^2g > ^2g-i> then we 
replace (4.24) on A% by (recall £ = 0) 

E{5l\H k }<q J2 D(£ 1 ...£ j [[D 1 £ j+1 } 2 ^-[D 1 £ j ] 2 ^} 

0<j<2q-2 

+D 2 e 1 ---e 2q -i tt 9-i-(2 ff -i)/2 du 



(4.29) 



t9 -l-(2 ? -l)/2 [:L _ /(c)] LJ/2j-2 ?+ l^ 

+ D 2 £ 1 ---£ 2q _ 1 



u q-l-q+l/2 



DxDd 



2q 



LJ/2j-2g+l 



< D 5 4 • • • t^-^Tq-X? + D b Ch ■■■£2q 

+ 2D X D 2 D±£ X ■■■£ 2q [l- /(C)] LJ/2j - 29+1 
+ D 1 D 2 D i £ 1 ■■■£ 2q [[J/2\/2-q)- 1 

< D 6 h ■ ■ ■ £ 2q [( + [1 - /(C)] LJ/2J-2»+i + j-i]. 

Here, we used the fact that J > 8q + 2. We also used (4.28) to conclude that 

+ Sj(s) > for s < u} < minj^i, 1 - /(C) j 
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for all j < J/2 and u in the domain of integration in the second and third 
integral in the first right-hand side (4.29). The constant D§ depends on q 
and 77 (or e) only and not on £ or J, provided J > 8q + 2. Without loss of 
generality, we take e < 1 and Dq > 1 . 
Finally, we take 

C = ? <i 

and use (4.25). We then see from (4.29) that there exists an J = J(q,e) such 
that for J > J(q,e) on A c n {£29-1 < C^2<?}, 

/or \ 2g— 1 /r \ 2<j— 1 

E{5l\H k }<Ddx(^f) K<eh(^f) ■ 
If £ 2q -i > Qhq, then let 

jo = max{j > : £j < (£ 2q }. 

Recall that £q = 0, so jo is well defined. Also, jo <2q — 2 since £25 > @2q-i > 
Q(-2q- Instead of (4.29), we now use 

E{si\H k }< q J2 D{e 1 -.-e j [[D 1 e j+1 ]^-[D 1 e j ]^} 

0<j<jo-l 

+ D 2 £ 1 ---£ jo / u q - l - m / 2 du 

+ D 2 e 1 ---e 2q -2 

g-l-(2g-2)/2r 1 _ j /^j [J/2J -2 ? +2 du 

+ D 2 £ l ---£ 2q _ l 

DxD^ L J / 2 J- a «+ 1 



(4.30) 



u g-l-g+l/2 



'[D 1 D 4 ^ 2g ] 2 

+ • -V2N 2 [i - /(c)F /2J - 29+2 

+ £)iD 2 D 4 ^i ■■■£ 2q [[J/2\/2-q)- 1 

< ^4N 2rl [C + C _1 [i - /(OF 2 ^ 2 + J- 1 ]. 

The factor C -1 multiplying [1 - /(C)] L J / 2 J- 2 ?+ 2 in the last member of (4.30) 
has been inserted to deal with the case q = l. Note that (4.30) is also valid 
in the case jo = (which contains the case q = 1,(^2 < h)- Indeed, jo = 
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means that (,t 2 q < f-i and then the sum in the first right-hand side of (4.30) 
is empty, while the first integral becomes 



D 2 



D 



[CD 1 £ 2g ] 2q <— D.hiCD^'- 1 . 



We leave it to the reader to check that in all these cases, there exists a J(q, e) 
such that for J > J{q,e), on A c n {£ 2q -i > Ch q }, (4.20) holds so that (4.20) 
has been proven in general. 

To go from (4.20) to (4.19), we take conditional expectations with respect 
to Gk, which is a sub-u-field of 7i k . This gives 



(4.31) 



L k .\ 2qi r 



<eE{£ 1 [^) [^(r^fl^ 



Taking this conditional expectation amounts to integrating out the Yj >k , 
which are independent of Q k . For the remainder of this proof, we restrict 
ourselves to the case k > 1; when k = 0, the proof simplifies. We use the 
facts that 

(4.32) < Xj(r k ) = Xj(T k -) - I[j = r(k)] + A j>k < X/fa-) + Y jjk 
[see (4.3)] and 



(4.33) 



J J 

3=1 3=1 



and t\{jk) < Y r r k ^ k since ^i(rfe) is the minimum of the Xj(T k ),l < j < J, 

and X r ( fc )(rfc) = ^(fc)^ by (4.3)-(4.5). Note that both r(k) and L k are 

measurable. Moreover, Y r r k ^ k is independent of (and hence of L k ) and 
has the distribution G. Also, for j ^ r(k), Yj jk and Y r ^ k are independent. 
Thus, 



(4.34) 



E{e 1 (L k y- 1 [x j (T k )]p\g k } 



<E(Y 



r(k),k 



-i 2g-l 



[*ifa-) + ij,*] p l& 



We shall frequently use the following special case of Holder's inequality: for 
any a,j > and for p > 1 , 



(4.35) 



Y. a 3 

lj=l . 



3=1 
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In particular, as a case with n = 2 and with n = J, we have 



i 2g-l 



l.k 



1=1 



< 2 2q ~ 2 < [L k ] 2q ~ 1 + 



E 3 ^ 



1 2q-l- 



Also, for p > 0, 
(4.36) 



[Xjin-) + Y hk f < 2P[X 3 (r k -)r + 2P[Y jt 



uk\ 



(We have a factor 2 P instead of 2 P_1 here to deal with the case <p < 1.) 
In agreement with the notation of (4.7), we write \i K for the fcth moment of 
G and use the fact that ^{[Y^fc^fYm^] 6 } < fi a +b for any 1 < £,m < J and 
a,b> 0, by Holder's inequality. We can therefore continue (4.31) with 

<2 2 ^ 2 [L k ] 2 ^[X 3 (r k -)rE{Y r(klk } 

+ 2 2 ^- 2 [Z fc ] 2 ^ 1 J B{i; (fc)ifc [y,, fc n 

+ 2 2^2 J 2 9 -2 [lj(Tfc _ )] p^ {yr(j:))i[y ^ ] 2,-l } 

l=\ 

+ 2 2 9+ p-2 J 2 g -2^^ {1;(fe)jfe[y ^ ] 2 ? -l [1 ,. fef} 



|2g-l 



<2 2 ^-VM 2 ^ 1 [^(T fc -)] p + 2 29+ ^V P+ i[^ 
+ 2 2 ^" 2 J 2q -\X 3 (r k -)r^ q + 2 2 ^" 2 J 2 ^V 29+P . 

Substitution of this estimate into (4.31) shows that if we take J > J(q,e) > 2, 
then for J > J(q,e), 



(4.37) 



^{^[^•(r fc )FI^}<e2 2 ^- 2 ^) 29 \^[X j (r k -)f + n p+l ) 
+ e2 2 ^- 2 [[X j {T k -)Yn 2q + n 2q+p ] 
<D 7 e{^\ 2q ~\x 3 {r k -)f 



[recall that Xj(r k — ) > 1 and L k > J — 1; see (4.10)]. The lemma follows by 
replacing e by e / Dj . □ 
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We define 

J J 

Q q {t) = = E[ X i(°)] 9 and for fc ^ 

i=i i=i 

J 

Q qtk = J2[X j (r k -)-I[j = r(k)]] q . 

3=1 

The quantity <5 g ,fc is a gth power analog of L k . Q q>k is the sum of the gth 
powers of the coordinates "just before" the adjustments at T k , but taking 
into account the jump of one coordinate from 1 to at r k . 

Lemma 3. Let the Xj(0) > 1 be fixed (nonrandom) and let q 6 {2,3, . . .} 
and k > 1. Assume that \x q := Y^n=\ n q G{{n}) < 00. There then exists some 
J(q) and for J > J(q), there exists an a(q) = a(q, J) such that for J > J{q) 
and a > a(q, J), 

E{Qq,k+l\Gk} < Qq,k - 9 2 ~ 9 ~ 1 Q(g-l),fc 

(4-38) 

< Q q k — 1 on the event {L k > a}. 

Consequently, v\{a) < 00 a.s. and the process {X(r k — )}fc>o is recurrent. 
Also, there exists some constant C\ = Ci(J,q,a,X(0)) < 00 such that for 
J > J(q) an d k>0, 

(4.39) E{Q qM1 I[u 2 (a) > k}} < C x . 

Proof. First, observe that all ti are almost surely finite. This follows 
by induction on £ from the fact that 

(4.40) n = J2 h 

k=l 

and the estimate (4.23) for the tail of the conditional distribution of 6 k . 
If T£ < 00, then almost surely £j(ji) < 00, and then 5e < 00 by (4.23), and 
hence T£ + ± < 00. 

We shall need the following inequality. For v > 2, there exists a constant 
Dg = Dg(v, D) such that on the event {r k < 00}, 

(4.41) EUSjin+i) ~ Sj(n)\ v \H k } < D 8 [l + E{5f\H k }}. 

This inequality is probably well known. For completeness, we shall outline 
a proof. Introduce 

Z(s,n) = Sj ( (r k + A r k+1 ^j - Sj ( (r k + ^ J A r k+1 J . 
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Then 
(4.42) 



Nn 



Sj(T k+1 ) - Sj(r k ) = lim Ymx^Z(s,n). 

s=0 



Moreover, for fixed n, the Z(s,n),s > 0, form a sequence of martingale dif- 
ferences with respect to the <r-fields 

^(( Tfc+ n) ATfc+1 ) yUk - 

Thus, by Fatou's lemma and the Burkholder-Davis inequality [see Gut 
(1988), Theorem A. 2. 2, or Hall and Heyde (1980), Theorem 2.10], 



E{\Sj(T k+1 ) - Sj(Tk)\ v \H k } < liminf liminf E< 



Nn 



s=0 



< Dg (v) lim inf lim inf E < 



JVn 

J2Z 2 (s,n) 
s=0 



v/2 



But, 



|Z(s,n)| < number of jumps of Sj during {{r k + s/n), (r k + (s + l)/n)], 



SO 



(4.43) 
Moreover, 

(4.44) 



Nn 

J> 2 ( S ,n)< 

s=0 



Nn 



s=0 



< [number of jumps of Sj during (r k , (r k + N + 1))]". 



Nn 



lim Z 2 (s, n) = number of jumps of Sj 



s=Q 



during (r k , (r k + N) A T k+1 ]. 



Conditionally on T~C k , the number of jumps in the right-hand side of (4.43) 
is a Poisson variable with mean D(N + 1). Since a Poisson variable has all 
moments, it is not hard to show the equality 



liminf E< 

n— >oo 



Nn 


v/2 




$> 2 ( S ,n) 




Wfcj 


s=0 






Nn 




v/2 



E{ lim 

n— >oo 



s=Q 
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= E{ [number of jumps of Sj during 

(4.45) 

(T k ,(T k + N)AT k+1 ]] v/2 \H k } 
< i?{ [number of jumps of Sj during 

(T k ,T k + NA(\r k+l -T k ])]] v/2 \n k }. 

But, conditionally on 7i. k , the jumps of Sj during (r k ,oo) form a Poisson 
process with jump rate D. By writing the number of jumps in (r k ,T k + N A 
(p7fc +1 — Tfc])] as the sum over r from 1 to N A (p7fc +1 — r^]) of the number 
of jumps in (r — l,r] and using Theorem 1.5.2 of Gut (1988), we then see 
that the right-hand side of (4.45) is at most 

(4.46) DgtffliVAfa+l-Tfcir^lW^ 

The inequality (4.41) follows from (4.42)-(4.46) because 5 k = T k+ \ — r k . 

We now fix q and a. Before we start on the proof proper of (4.38), we 
should show that the conditional expectation in the left-hand side of (4.38) 
makes sense, that is, E{Q q> k+i} < oo. To this end, we observe that by (4.2), 
on the event {r k < oo}, 

Xj( Tk+1 -) - I[j = r(k + 1)] = Xj(r k ) + Sj{T k+1 ) - Sj(r k ) 

and hence 

J 

Q q , k+1 = Y,l X j(Tk)] q 

(4.47) 

+ EE (l) [Xj(r k )r u [Sj(r k+1 )-Sj(n)}\ 

j=lu=l V / 

Furthermore, for k > 1, 

(4.48) Xj{r k ) = Xj(r k -) - I[j = r(k)] + A j>k 

[see (4.3)], so for k > 1 [see (4.35)], 

jl[X 3 {rk)] q = J2[Xj(r k -) - I[j = r(k)} + A hk f 

3=1 3=1 

(4-49) < E[^(r fc -) - I[j = r(fc)]] 9 + 2^ £ \^ k \ q 

3=1 3=1 
J 

= 2^ 1 Q q , k + 2^ 1 Y / \A j ,k\ 9 - 

3=1 
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Now, note that by (4.41), 

#{|<%(ri) - ^(ro)! 9 } < D s [l + E{5\ /2 }] 

and by virtue of (the proof of) Lemma 2, there exists some J\(q) such that 
E{5\ 12 } < oo for J > Ji. In fact, (4.23) and (4.24) show that J > 2q suffices 
for this. Then (4.47) shows that E{Q q) {\ < oo for J > J\ [recall that the 
Xj(0) are nonrandom]. From there on, we apply induction on k to show 

that E{Q q>k } < oo and E{5 <1 1 / 2 } < oo for all k, by means of (4.47), (4.49), 
(4.41), (4.19) and 

EUXjinnSjin+i) - Sj^r} 

(4.50) 

< [E[X 3 (r k )f]^l\E{\S 3 (r k+1 ) - S^}]^. 

This shows that the conditional expectation in (4.38) is well defined. 
We turn to the proof of (4.38) itself. The basic relation is 

E{Xi(r k+1 -) - I[j = r(k + 1)] - Xi(T k )\H k } 

(4-51) 

= E{&(T k+1 )-&(T k )\H k } = 0, 

which follows from Wald's equation [see Chow and Teicher (1978), Theo- 
rem 5.3.1; this reference deals with discrete-time random walks only, but 
we can again approximate T k+ \ by \mT k +{\/m and let m go to infinity]. 
Combined with (4.47), (4.51) implies that 



E{Q g , k+1 \H k } = Y,E\ [XjfaW + E U ) ^ T ^ 9 ~ u 

3=1 V u=2 V 



(4.52) 

x [5 i (r fc+1 )-^(r fc )]"|H fc l. 

We shall fix e > in (4.60) below. In the last sum, we then have for u>2 
and J > J(q, e), 

j2mx3{r k )\ q - l V 3 {T k+l )- S 3 {r k )\ u \n k } 

(4.53) j 

<D 8 J2[X3(r k )r u [l + E{5 u k /2 \n k }} 
j'=i 

[by (4.41) and the "Hfc-measurability of Xj(r k ); note that we used Xj(t) > 
so that Xj(t) = \Xj(t)\]. Next, by (4.32) and (4.36), for q > u, 

[x i (T fc )]^<2^[x i (T fe -)]«-" + 2'- w [y i:fe ]^ w 
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By taking conditional expectation with respect to Q k m (4.53) and using 
(4.19), we now obtain 



< D 



10 



1 + e 



J 



■3=1 



But, Xj(r k -) = Xj(r k -) - I[j = r(k)] for all j / r(k), and X r ^(r k -) = 1. 
Therefore, 



J- 1 < J2i x i( T k-)] q ~ u < Q( q -u),k + 1 < zQ( q -u),k- 

i=i 

We then also have 

E{Q q , k+ i\Gk} 

= E{Q q , k+1 - Q q (T k )\G k } + E{Q q (r k ) - Q q , k \Gk} + Q q ,k 



(4.54) 



14=2 



' T 



u-1 



Q(q-u) r 



+ £{<2 g (ffc) - Q«7,jfc|<?fc} + Qq,fe 



^12 E 



m=2 



' T 



u-1 



Q(q—u 



),k 



+ £ £{[X,-(t*-) - /[j = r(k)] + A,- A 



-[X j (r k -)-I\j = r(k)]] q \g k } + Q q , k . 

We turn to a bound when k > 1 for the second sum in the right-hand side 
here. Its summand equals 



(4.55) 



E{[Xj(r k -) - I[j = r(k)} + A hk f - [Xjfa-) - /[j = r(fc)]]*|&} 



= qE{A hk [X*(j,k)) q - 1 \Gk} 

for some X*(j,k) between Xj(r k — ) — /[j = r(A;)] and Xj(rjt). We now con- 
sider two cases. 

Case (i): Xj(r k —) > 2. In this case, Aa k = —1, j ^ r(k), and 

ftXjfa-) - I[j = r(k)\] = \X 3 (T k -) < Xjfa-) - I[j = r(k)] - 1 

= Xj{Tk) < X*(j,k) < Xj{Tk-) - I[j = r(k)}, 
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so 



A jik [X*(j,k)} q ~ 1 < -2 l -i[X 3 {r k -) - I[ J =r(k)]r 1 . 
Hence, the right-hand side of (4.55) is at most 

in case (i). 

Case (ii): Xj[r k — ) = 1- Then < Aj k < Yj k and 

< X 3 (r k -) - I[j = r(k)} < X*(j, k) < Xj(r k ) = Y hk . 
Thus, in this case, 

A^lX^j^^-^lY^f. 

If we set 

U k = {l<j< J:X j {T k -)>2}, 

then 

j^E{[X 3 {r k -) - I[j = r(k)} + Aj jk ] q - [Xj(T k -) - I[j = r(kW\G k } 

3=1 

< q £ (-2^)[Xj(r k -) - I[j =r(k)]r l + q £ E{[Y hk f} 

jeU k j£U k 

< {-q2 l -«)Q {q ^ k + q2 l -« £ [X 3 (r k -) - I[j = r^)]] 9 " 1 + qj >, 

< {-q2 1 - q )Q {q _ 1)M + g2 1 -«(J - \U k \) + qJfi q 

(because Xj{r k -) - I[j = r(k)) < 1 for j U k ) 

< (-q.2 l ~ q )Q{ q -i), k + d 13 j. 

Substitution of the estimates in cases (i) and (ii) into (4.54) shows that 



E{Q q , k+ i\G k }<D 12 Y^ 



(4.56) 



u=2 



q2 1 q Q {q -i), k + D 13 J + Q q>k . 



' T 



u-1 



Q(q-u),, 



On {L k > a}, if q > 2, we have 

(4.57) ofl- 1 <[L fe r 1 <J q - 2 Q( q -i), k , 
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by virtue of (4.35). Thus, we can choose a > J so large that D13 J < q2 9 Qr q -i\ k 
and 



1 r 



E{Q q , k+1 \G k } < D^Y, 



(4.58) 



u=2 



Q(q—u),k 



<fl~ q Q{ q -llk + Qg„ 



on {Lfc > a}. 

The last estimate which we need is that 



(4.59) 



T \ W— 1 



— ) Q(q-u),k < Q(q-l),k for 2 < M < (J. 



Before we prove this, we show that it implies the lemma. Indeed, (4.58) and 
(4.59) show that on {L k > a}, 



E{Q q k+i\Gk} < 



D12 £ 



u=2 



J 

IT 



u-1 



+ D 12 qe - q2~« 



u=2 



< 

If e is chosen so that 
(4.60) 

and a > J is chosen so that 
J 



£12 E H +D l2 qe-q2- (l 



a 



Q(q-l),k + Qg.fc 
Q(q-l),k + 



0<£< 



1 



D 12 2i+ 3 



D 



12" 



< g2 - ''- 2 and g2~ 



9-1 



J9- 



> (£>i 3 J) V2, 



' a — J 

then we have, on {L k > a}, 

(4.61) £{4,,fc+i|£fc} < -g2-«- 1 Q (g _ 1) , fe + Q 9ifc < Q g , fc - 1. 

Thus, (4.38) will follow from (4.59). In turn, (4.38) implies that v\{a) is 
almost surely finite and the chain {U k } is recurrent, by the well-known 
criterion of Foster [see Theorem 2.2.1 in Fayolle, Malyshev and Menshikov 
(1995)]. 

As for (4.39), note that regardless of the value of L k , we still have by 
(4.56), (4.59) that 

(4.62) E{Q q , k+1 \Q k } - Q q>k < C 2 Q (g _ 1)jfc + D 13 J 

for some constant C 2 = C 2 (J,q,e). If L k < a, then Xj(r k — ) < a + 1 for each 
j and hence Qt q -i),k — J{ a + 1)* 7-1 - In particular, on the event {v\ = £} £ Qg, 
we have Li<a and 

(4.63) E{Q q4+1 \g t }-Q qt t<C 3 
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for some constant C3 = Cs(J,q,e,a). Now, let k>£+l, multiply (4.38) by 
I[v 2 (oi) > k,ui(a) = £] and take conditional expectations first with respect 
to Q k and then with respect to Qi_. This gives 

E{Q q , k+1 I[v 2 (a) > k,u 1 (a)=£]\g e } 

< E{Q q , k I[v 2 (a) > kM<*) = i]\Gi} 

< E{Q q>k I[u 2 (a) > k — («) = t\\Gt}. 
By iteration of this inequality, we obtain 

E{Q qtk+1 I[u 2 (a) > k,u 1 (a)=£]\g e } 

< E{Q q ^ + \I[i'i = £]\0e} (since we always have v 2 > v{) 
<[Q q ,i + Cs]I[vi=£] 

< [J (a + l) q + C 3 ]I[u! = £} [by (4.63) and the lines before it]. 

By (4.63), the inequality between the extreme members here remains valid 
for k = £. Taking expectation in this inequality and summing over £ = 
1,2, ... ,k then gives 

(4.64) E{Q q>k+1 I[u 2 > k> ui]} < [J {a + If + C 3 ]P{^i < k}. 
Further, by (4.61) or (4.38), because L k > a on {ui > k}, 

E{Q q , k+ iI[v 2 >k,u 1 >k}} = EiQq^xI^ > k]} 

< E{Q q , k I[v x > k}} [by (4.61) or (4.38)] 
<E{Q qjk I[v x >k-l]} 

< < E{Q qtl I[ Vl > 0]} = E{Q g , 1} < 00. 

The last in equality was proven just before (4.50). Adding this to (4.64) 
finally gives (4.39) for k > 1. For k = (4.39) again reduces to E{Q q< i} < 00, 
since v 2 > v\ > 1 by definition. 

It remains to prove (4.59). To this end, we recall that [L k / J]^ 1 < Q( u -i) t k/ J 
for u > 2 [see (4.57)]. Thus, it suffices to prove 

1 ~ 1 ~ 1 ~ 

(4.65) -jQ( u ~i),kjQ(q-u),k < jQ(q-i),k for 1 <u< q. 

But this is a simple case of the Harris-FKG inequality (with respect to 
the measure which assigns mass \ j J to each point Xj{r k —) — I[j = r(k)], 
l<j<J). □ 

Proof of Theorem 4. We take q = 2 and fix e as in (4.60). We also fix 
J such that J > J(2, e) [see Lemma 2 for J(q,e)], J > J(2) and a > a(2, J) 
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[see Lemma 3 for J(2), a(2, J)]. We abbreviate l\y\ > k] to I k and similarly 

(2) 

write I k for J[f2 > k]. As we already pointed out, it suffices to prove that 
for any initial state, (4.12) and (4.13) hold. We claim that, in turn, these 
inequalities will follow from 

oo 

(4.66) ^T[P{^>£;}] 1/2 <oo. 

k=i 

To see this, first note that P{v 2 > k} < [P{u 2 > k}] 1 / 2 . Thus, (4.66) will 
imply (4.12). 

Next, recall that we already showed in the beginning of the proof of 
Lemma 3 that r k < oo a.s., so the U k of (4.11) is well defined for all k 
[see (4.40)]. We also showed just before (4.50) that for any initial state, 
E{Q 2)k } < oo- From (4.19) with p = and q = 1, we then see that 

E{8 k }<sE{^}=sE{9f}<eE{ 
We then also have 

(4.67) E{T k }=Elj2 6 j) <oc - 

Now, assume that (4.66) has been proven and use the relations 

oo 

k=l 

and 

E{5 k I { k 2) } < jE{L k I { k 2) } [by (4.19) with q = 1, p = and {u 2 > k} G Q k \ 

<^[E{[L h fl^}P{v 2 >k}] l l 2 

<C4E{Q 2tk I ( k 2) }P{v 2 >k}} 1/2 

[by the Schwarz' inequality or by (4.35)] 

< C4dP{u 2 > k}] 1 / 2 [by I {2) < if^ and (4.39)]. 

Moreover, as we just proved, E{t{\ < oo, so (4.66) will indeed imply (4.13). 
Now, to prove that (4.66) indeed holds, we consider the {C? n }-martingale 

71- 1 

M n :=Y,iQ2,k+i - Q2,k ~ E{Q 2yk+l - Q 2 , k \Q k }]I ( k \ n > 1. 

k=l 



I < OO. 
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(2) 

We note that on {z^ > n}, each 1^ , 1 < k < n, equals 1, so by virtue of 
(4.38), 

^{Q2,fe+l - Q2,k\Gk} < -1, 1 < < n, / l/i. 

On {z/i = fe}, 

^{Q2,fc+1 — <22,fc|(5fc} < C3, 
by virtue of (4.63). Consequently, 

n-l 

M n >Y, [Q2,k+i ~ Q2M +n-2-C 3 

k=l 

= Q2,n-Q2,i + n-2-C 3 on{u 2 >n}. 
Since Q 2 ^ n > by definition, it follows that 

P{»2 >n}< P{M n + Q 2>1 >n-2-C 3 } 

< (n - 2 - C 3 )^2 4 {E{\M n f} + £{[Q 2 ,i] 5 }}. 
But, (4.35) and our remarks just before (4.50) show that 

£{[Q 2 ,i] 5 }<^ 4 £{<3io,i}<oo 

for large enough J. Thus, it suffices for (4.66) to prove 
(4.68) E{\M n f}<C 5 n^ 2 . 

But, by Burkholder's inequality [see Gut (1988), Theorem A. 2. 2 or Hall and 
Heyde (1980), Theorem 2.10], 

5/2 N 



E{\M n \ 5 }<C 6 E< 



n-l 



5lK?2,fc+l ~~ Q2,k - E{Q 2k+ i - Q2,k\Gk}] 2 I l 



2,(2) 



k=l 



{n-l 
ElQ2,fe+i - Q2,k - E{Q 2tk+1 - Q 2>k \g k }\ a I, 
k=l ) 

[by (4.35)] 

n—l n—1 

< C 7 3V/ 2 ^ E{\Q 2 ,k + i\ 5 ^ ] } + C 7 3V/ 2 Y: E{\Q 2 , k \ 5 I ( k 2) } 



5r(2) 



fc=l 

n-l 



fe=l 
|5 r (2)- 



+ C 7 3 4 n 3 / 2 ^£;{|i5;{Q 2ifc+1 -Q 2ife |g fc }| 5 /f } [by (4.35)] 

k=l 

n-l 

< C 7 3 4 (l + 2 4 )n 3 / 2 E{\Q 2M1 \ 5 I { k 2) } 



k=l 
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n-1 

+ C 7 3 4 (l + 2V /2 E^{l^ fc | 5 4 2) } 
k=l 

n 
k=l 

Finally, by (4.35) once more, 

\Q2,k\ 5 — J 4 QlO,k 

~ (2) 

and E{QiQ^Ij,_ l } is bounded in k by virtue of (4.39). Thus, (4.68) and 
(4.66) hold. This proves (4.13) and, as we pointed out before, it also proves 
(4.17) and (4.8). 

Since (4.8) is our main conclusion in Theorem 4, we leave it to the in- 
terested reader to prove that (Xi(t), . . . ,Xj(t)) is irreducible and positive 
recurrent. □ 
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